Reduced precision discretization based on information theory
نویسندگان
چکیده
In recent years, new technological areas have emerged and proliferated, such as the Internet of Things or embedded systems in drones, which are usually characterized by making use devices with strict requirements weight, size, cost power consumption. As a consequence, there has been growing interest implementation machine learning algorithms reduced precision that can be these constrained devices. These cover not only learning, but they also applied to other stages feature selection data discretization. this work we study behavior Minimum Description Length Principle (MDLP) discretizer, proposed Fayyad Irani, when is used, how much it affects typical pipeline. Experimental results show fixed-point format sufficient achieve performances similar those obtained using double-precision format, opens door reduced-precision discretizers systems, minimizing energy consumption carbon emissions.
منابع مشابه
Information Theory Tools for Scene Discretization
Finding an optimal discretization of a scene is an important but difficult problem in radiosity. The efficiency of hierarchical radiosity for instance, depends entirely on the subdivision criterion and strategy that is used. We study the problem of adaptive scene discretization from the point of view of information theory. In previous work, we have introduced the concept of mutual information, ...
متن کاملtranslation of collocations from english into persian, based on ghazalas theory
غزالا همایندها را به صورت ترکیبی از دو یا چند واژه که همواره در متون مختلف زبان ها همراه با هم می آیند تعریف می نماید. از دیدگاه او روند رو به رشد میل به ترجمه ی همایندها در مطالعات ترجمه، به دلیل اهمیت آنها در انسجام ساختار زبان است. این پایان نامه اساسا به ترجمه ی همایندها منحصر شده است. هدف آن بررسی کاربرد راهکارهای غزالا در مورد ترجمه ی همایندها از انگلیسی به فارسی است. هدف دیگر آن یافتن پر...
15 صفحه اولEfficient Control Discretization Based on Turnpike Theory for Dynamic Optimization
Dynamic optimization offers a great potential for maximizing performance of continuous processes from startup to shutdown by obtaining optimal trajectories for the control variables. However, numerical procedures for dynamic optimization can become prohibitively costly upon a sufficiently fine discretization of control trajectories, especially for large-scale dynamic process models. On the othe...
متن کاملConstructing neural networks for multiclass-discretization based on information entropy
Cios and Liu (1992) proposed an entropy-based method to generate the architecture of neural networks for supervised two-class discretization. For multiclass discretization, the inter-relationship among classes is reduced to a set of binary relationships, and an independent two-class subnetwork is created for each binary relationship. This two-class-based method ends up with the disability of sh...
متن کاملOn the Theory and Algorithm for rigorous discretization in applications of Information Theory
We identify fundamental issues with discretization when estimating information-theoretic quantities in the analysis of data. These difficulties are theoretical in nature and arise with discrete datasets carrying significant implications for the corresponding claims and results. Here we describe the origins of the methodological problems, and provide a clear illustration of their impact with the...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Procedia Computer Science
سال: 2022
ISSN: ['1877-0509']
DOI: https://doi.org/10.1016/j.procs.2022.09.144